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STOCHASTIC DOMINATION FOR A HIDDEN MARKOV CHAIN 
WITH APPLICATIONS TO THE CONTACT PROCESS IN A 
RANDOMLY EVOLVING ENVIRONMENT 

By Erik I. Broman 

Chalmers University of Technology 

The ordinary contact process is used to model the spread of a 
disease in a population. In this model, each infected individual waits 
an exponentially distributed time with parameter 1 before becoming 
healthy. In this paper, we introduce and study the contact process in a 
randomly evolving environment. Here we associate to every individual 
an independent two-state, {0, 1}, background process. Given So <5i, 
if the background process is in state 0, the individual (if infected) 
becomes healthy at rate 5o, while if the background process is in 
state 1, it becomes healthy at rate Si. By stochastically comparing the 
contact process in a randomly evolving environment to the ordinary 
contact process, we will investigate matters of extinction and that 
of weak and strong survival. A key step in our analysis is to obtain 
stochastic domination results between certain point processes. We do 
this by starting out in a discrete setting and then taking continuous 
time limits. 

1. Introduction. The first part of tliis introduction will discuss the con- 
cept of stochastic domination and then move on to state our discrete time 
results. We will then proceed by defining the contact process in a randomly 
evolving environment (CPREE) that we introduce in this paper. We would 
like to point out that a model called the contact process in a random envi- 
ronment (CPRE) has been studied before. The first papers concerning this 
latter model were [2] and [8], and then further studies were carried out in, 
for instance, [1, 9, 13] and [14]. However, the random environments in those 
papers are static while here they change over time. 

In this paper we are concerned with models on connected graphs G = 
{S,E) of bounded degree, in which every site s £ S can take values or 1. 
Here a and ^ will mainly denote configurations on S, that is, o", ^ G {0, 1}"^. 
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We say that ^ ^ ^ if ^(s) < ^(s) for every s £ S. An increasing function / 
is a function /:{0,1}^ such that /(^) < f{i) for all ^ ^ i. For two 
probability measures /i' on {0, 1}"^, we write /x ^ if for every continuous 
increasing function / we have that < /x'(/)- is shorthand for 

/ f{x)dfi{x).] Strassens theorem (see [10], page 72) states that if /U ^ f-i' , 
then there exist random variables X, X' with distributions fi, fi', respectively, 
defined on the same probability space, such that X ^ X' a.s. 
We will need the following standard definition. 

Definition 1.1. Let 5 be such that IS] < oo and let ^ be a probability 
measure on {0, 1}"^ with full support, /j, is said to be monotone, if for every 
s £ S and any G {0, 1}'^^'' such that ^ ^ f , one has that 

f,{a{s) = l\a{S \ EE e) < = l\a{S \ s) ee i). 

If IS"! = oo, we say that a probability measure /U on {0, 1}'^ is monotone if 
the restriction of /i to any finite subset of S is monotone. 

For p G [0, 1], let each site s £ S, independently of all others, take value 1 
with probability p and with probability 1 — p. Write iTp for this product 
measure on {0, 1}'^. For any probability measure fi on {0, l}'^ define Pmax/i 

by 

Pmax.M := SUp{p £ [0, 1] : VTp ^ ^}. 

The supremum is easily seen to be obtained, which motivates the notation. 
Similarly define 

Pmin,fj. ■■= inf{p G [0, 1] : ^ VTp}. 

Next, informally here we will think of {i?n}5^i as a background process 
which influences another process Formally, fix < ao ^ cki < 1 and 

let {Bn}^=i be any process with state space {0, 1}. Conditioned on {Bn}^^i 
let the process {^nj^i, also with state space {0, 1}, be a sequence of condi- 
tionally independent random variables where the (conditional) distribution 
of Xk is 

if then w.p. 

(1) Bk = Xk = l ao 

Bk = l Xk = l ai 

for every A; > 1. 

We will say that /_f is translation invariant on N if for every / > 1, /c > 
and any ^ G {0, l}{i'-''i 

^i{a{l,...,l)=0 = ^i{cT{k + l....,k + l)=i). 

In Section 2 we will prove the following proposition. 
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Proposition 1.2. A ssuTfie. that the distvibution of is mono- 

tone and translation invariant. Then the sequence 

{P(X„ = l|X„_i = . . . = Xi = 0)}„>i, 

is decreasing in n. In addition the limit equals Pmax,^; where fx is the distri- 
bution 0f{Xn}n=l- 

The proof is an easy consequence of results from [5] and [12]. 

We are now ready to define the discrete background process that we will 
use throughout this paper. For p, 7 G [0, 1], define the Markov chain {Bn}^=i 
in the following way: 



(2) Bi 
and for k>2, 



1, w.p. p, 
0, w.p. 1-p, 



if then w.p. 

(3) Bk-i = Bk = l -fp 

Bk-i = l Bk = 7(1 -P)- 

In other words, takes the same value as Sfc-i unless there is an update 
which happens independently with probability 7. If an update occurs, iJ^ = 1 
with probability p, and Bk = with probability 1 — p. Using (1) this defines 
a joint process {{Bn, Xn)}^=i, whose second marginal is an example of a so- 
called hidden Markov chain. The main theorem of Section 3 is the following, 
here refers to the distribution of with the background process as 

above. 

Theorem 1.3. We have that 



where 



and 



Pmax,/. = i(l - C - y'(l - C)2 - 4D), 

C = (1 - ao - ai) - 7(1 - ao - (1 -p){ai - ao)) 
D = aoai + 7(ai(l - ao) - (1 -p)(ai - ao))- 



Furthermore, 



Pmin,f. = i(l + C + ^(1 - C7')2 - 4D'), 



where C and D' are as C and D but with ao,ai,p and 7 replaced by 1 — ai, 
1 — ao, 1 — p and 7, respectively. 
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Remark. It is easy to check that Pniax,/^ (^Pmin,fi) is increasing (decreas- 
ing) in 7. This is natural since intuitively, as 7 increases, {^n}^i looks 
more like an i.i.d. process and so our approximations should get better. 

The proof of Theorem 1.3 unfortunately involves some tedious (but straight- 
forward) calculations; however this result is needed for all the other results 
of this paper. 

From the results of Section 3, we will in Section 4 prove our next result. 
First define 

n 
i=l 

where c indicates that we are counting the number of I's up to time n. The 
pair of processes {{Bt.,Xt)}t>Oi to be defined below will be a Markov process. 
Furthermore, it will be the continuous time analogue of the pair of processes 
{(B„,X^)}^=i. To define {(5j, Xt)}t>o, let Bq = 1 with probability p and 
-Bq = with probability 1—p, also let Xq = 0. We define the transition rates 
at time t > 0, for the Markov process {{Bt, Xt)}t>o as follows: 



from 


to 


with intensity 


{0,k) 


il,k) 


7P 


{l,k) 


iO,k) 


7(1 -p) 


{0,k) 


{0,k + l) 


ao 


{l,k) 


{l,k + l) 


ai 



for any k>0. Informally this can be described in the following way. Letting 
the value of Bq be chosen as before, the {Bt}t>o process waits an exponen- 
tially distributed time with parameter 7 > before it updates its status. 
After an update, this process takes value 1 with probability p and with 
probability 1 — and all of this is done independently of everything else. If 
the background process is in state 0, {Xt}t>o increases by one every time 
a Poisson process with rate ao has an arrival. If instead the background 
process is in state 1, {Xt}t>o increases by one every time a Poisson process 
with rate ai has an arrival. In short, {Xt}t>o is the counting process for 
a type of Poisson process where the parameter comes from {Bt}t>o- Anal- 
ogous to the definition of Pmax,u) 

define Amax,/^; where ^ here refers to the 
distribution of {Xt}t>o, in the following way. Aniax,/i is the maximum real 
number A such that a Poisson(A)-process can be coupled with the process 
{Xt}t>o so that if the Poisson(A)-process has an arrival at time r G [0,oo) 
then so does the {Xt}t>o process. In other words, there exists {Xj-}t>o with 
distribution Poisson(A) coupled with {Xt}t>o such that 

Xt — X[ is nondecr easing in t. 
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Define Amin,^ to be the minimal real number A such that a Poisson(A)-process 
can be coupled with the process {Xt}t>o so that if the {Xt}t>o process has an 
arrival at time r € [0,oo) then so does the Poisson(A)-process. Observe that 
Amax,/i = Amax,^("05 Oil 7)P)- We will Write out the arguments in most equa- 
tions, but not in more general discussions. Trivially ao !^ Amax,/i < Amin.^t < 
ai. For future convenience let PoiJJ'^^ denote the distribution of {Xt}t>o 
and PoIa denote the distribution of a Poisson process with intensity A. The 
coupling described above is a form of stochastic domination and we will 
write 

(4) PoiA_„:<PoiZ'j:„„ 
and 

(5) Poil'P^ ■< Foix . . 
Define 

A = A(Qo,ai,7,p) 

:= i(ao + ai + 7 - \/ ("i - ao - 7)^ + ^7(1 - p)(ai - ao))- 

Before stating our next result we would like to point out that the pair 
of processes {{Bt, Xt)}t>o has been studied before (see [7] and some of the 
references therein). However, in these papers the focus and motivation for 
the study is completely different from ours, the question of interest being 
how to best determine Bq by observing the {Xt}j>o-process. See further the 
remark after Theorem 1.5 below. 

Theorem 1.4. Let {{Bt,Xt)}t>o be as above. For every choice of ao, 
a\, 7 > with ao < ai and p G [0, 1] we have that 

(6) Amax,^t(ao,ai,7,p) = A, 
and for p> 

Amin,/i(ao,ai,7,p) = ai. 

Remarks. 

• Note the apparent lack of symmetry between Amax,/^ and Amin,^- Infor- 
mally, consider for a moment the model to be a point process, where the 
process is unless there is an arrival, in which case it takes the value 1. We 
can then see that the true symmetric statement of the Amax,^ result would 
concern a model which is 1 unless there is an arrival in which case it takes 
the value 0. This however does not correspond to the result concerning 

Amin,^- 
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• We will show in Section 4 that Amax,^t(aO) oi) 7)P) ^ niin(ai,ao + 7) as 
p — > 1. Hence if 7 > ai — ao, then Amax,^(ao5 0!i,^,p) ^ ai as 1 which 
one would expect. In contrast, for every p> Amm,^(cKo,"i,7,p) = cki 
and so Amin,/i(ao, oi, 7,p) 7^ ao as p ^ as one might have suspected; this 
gives a discontinuity at p = 0. Also, it is trivial to show that 

Amax,/i(ao,"i,7iP) ^ "0 as 0. 

• Intuitively, as 7 grows larger, the suppressing of possible arrivals becomes 
"increasingly independent." Whenever a possible arrival occurs, the back- 
ground process has with very high probability been updated since the last 
possible arrival, and if so the new arrival is suppressed independently of 
everything else. Therefore, as 7 grows larger, we would expect our process 
to look more and more like an ordinary Poisson process. As a consequence, 
we would expect our approximation to get better. This is confirmed by 
studying the derivative of A with respect to 7; it is easy to check that 
A is increasing in 7. Furthermore, for fixed < p < 1, it follows from the 
proof of Proposition 1.9, where we take the limit 7 ^ cxo in equation (6) 
above, that lim^_»oo Amax,/i(ao, "1, 7,p) = P<^i + (1 —p)oio- Of course this is 
exactly what you would expect to get. Also, by letting 7 ^ in equation 
(6) we get that Aniax,/i(ao, cti, 0,p) — > ao. This last result is also natural. 
As 7 becomes smaller, we will find longer and longer time intervals in 
which the background process is in the lower state. Therefore the Poisson 
process we dominate must have lower and lower density. 

It is natural to ask for quantitative versions of Theorem 1.4 for finite time, 
and in fact we will use such results to prove Theorem 1.4. Therefore, for 
T > 0, let A^a^x,^('^o, cn, 7,p) denote the maximum intensity of the Poisson 
process which the second marginal of the truncated process {iBt,Xt)}t£[o,T] 
can dominate. Define ^mm,fii'^o, oi, 7,p) analogously. We feel that this bound 
is interesting in its own right and we therefore present it in our next the- 
orem together with a lower bound on A^a^x,/i('^o, ai, 7,p) and a result for 
A^jjj ^(ao, ai, 7,p) (this last result will follow from the proof of Theorem 
1.4).' 

Let 

L = L(ao,ai,7,p) := J (ai - ao -7)^ + 47(1 -p){ai - ao). 



Theorem 1.5. For every choice of ao,ai,7,T > with ao < ai and 
p G (0, 1) we have that 

(7) A^ax,M(«o,ai,7>P) > A + (pai + (l-p)ao-A)e"^^. 
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Furthermore there exists a constant E > 0, depending on ai,ao;7 o.^d p, 
such that 

1 - 1 - e~^^ 

(8) A^ax,M("o,ai,7,P) < A + -(pai + (1 -p)ao - A) . 

Finally 

Amin,/i ~ Amin,;^ = Oil- 

Remarks. 

• Observe that the right-hand side of equation (7) tends to pai + (1 — p)ao 
as T tends to 0, and that it tends to A = Xmax,^i{cto,ai,^,p) as T tends 
to infinity. Both results are of course what you would expect. The same 
is true for the upper bound of equation (8). 

• In [7] they calculate the probability density Fij{t) of the first arrival of 
{Xt}t>o occurring at time t while Bt = j given that Bq = i. Through 
a nontrivial although straightforward series of calculations it is possible 
from their results to arrive at the conclusion that 

for some constant c. However, this result does not give the right asymp- 
totic behavior as T tends to 0. Furthermore, since this approach also rests 
on work needed to arrive at the expression for the probability density 
Fij{t) we do not use the results of [7] in our proof. 

1.1. Models. 

1.1.1. The contact process. In this section we will discuss some basic 
concepts concerning the contact process, see [10] for results up to 1985 and 
[11] for results between 1985 and 1999. Consider a graph G = {S,E) of 
bounded degree. In the contact process the state space is {0,1}"^. We will 
let 1 represent an infected individual, while a will be used to represent a 
healthy individual. Let A > 0, and define the flip rate intensities to be 

ri, ifa(s) = l, 

(9) Cis,a) = l A Yl ^(«'), ifa(s) = 0. 

I {s',s)GE 

By flip rate intensities, informally, we mean as usual that every site s € 
S waits an exponentially distributed time with parameter C{s,a) before 
changing its status. Here, Iq, li will denote the measures that put mass one 
on the configuration of all O's and all I's, respectively. If we let the initial 
distribution be cr = 1, the distribution of this process at time t, which we 
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will denote by liTx(i), is known to converge as t tends to infinity. This is 
simply because it is a so-called "attractive" process and a = 1 is the maximal 
state; see [10], page 265. This limiting distribution will be referred to as the 
upper invariant measure for the contact process with parameter A and will 
be denoted by ux- We then let denote the stationary Markov process on 
{0,1}'^ with initial (and invariant) distribution i>x. One can also choose to 
start the process with any set ^ C S" of infected individuals and then use 
the flip rate intensities above. Denote this latter process by ^i'^'^. We say 
that the process dies out if for any s £ S 

^^•^"^(CTt^O Vt>0) = 0, 

and otherwise it survives. We also say that the process survives strongly if 

^^'^">((Tj(s) = l i.o.)>0. 

We say that the process survives weakly if it survives but does not survive 
strongly. These and all other statements like it, made here and later, are 
independent of the specific choice of the site s; see [11]. We will use the 
same definition of survival for some closely related processes below. It is 
well known that for any graph (see [11], page 42) there exists two critical 
parameter values < Ad < Ac2 < oo such that: 

• dies out if A < Ad, 

• vi/^'{*} survives weakly if Ad < A < Ac2, 

• ^'^''1*} survives strongly if A > Ac2- 

The above description of the contact process with flip rate intensities 
chosen according to (9) is standard. However for our purposes it is more 
convenient to use the following flip rate intensities. Let 6 > and 

r S, if a{s) = 1, 

(10) C{s,a) = l Yl ^(^'), if^(s) = 0. 

I is',s)£E 

This is just a time scaling of the original model. We will denote the upper 
invariant measure by and the corresponding process starting with distri- 
bution by ^s- If we instead choose to start with a specific set j4 C 5" of 
infected individuals, we denote the corresponding process by We win 
let the distribution of the process at time t>0 he denoted by vf^. At some 

point we need to consider the process ^g'"^, this is exactly like the model 
just described except for a A inserted in front of the sum in equation (10). 
As above, it follows that there exists < (5d < 5c2 ^ oo such that: 

• dies out if (5 > 6c2, 

• ^f'^ survives weakly if 6ci < 6 < 6c2, 
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is} 

• survives strongly if 5 < 5ci ■ 

We point out that on G = Z'^ it is known (see [3]) that 6ci = &c2- It is also 
well known (see [11]) that on any homogeneous tree of degree larger than or 
equal to 3, this is not the case. 

1.1.2. CPREE. This model is a pair of processes {{Bt,Yt)}t>Q with state 
space {{0,1} X {0,1}}'^. The second coordinate of {{Bt^Yt)}t>o will repre- 
sent whether an individual is infected or not, while the first coordinate will 
represent how prone the individual is to recover. With a slight abuse of no- 
tation we have chosen the first coordinate to be denoted by {Bt}t>Q even 
though a process with this notation was already defined previously in the 
Introduction. However, at every site s £ S, the marginal of the {Bt}t>o pro- 
cess defined in this subsection [denoted by {Bt{s)}t>o] will be independent of 
the rest of the {Bt}t>o process defined here, and have distribution according 
to the process with the same notation defined earlier. It will be clear from 
context which of these two we are referring to. 

For any Ac S, let Yo{s) = 1 iff s E A, and let Bq ~ vr^. For < Sq < Si < 
oo, 7 > and p £ [0,1], let the flip rate intensities C{s,{Bt,Yt)) of a site 
s £ S he 

from to with intensity 

(0,0) (1,0) 7P 
(0,1) (1,1) IP 

(1.0) (0,0) 7(1 -P) 

(1.1) (0,1) 7(1 -P) 
(0,0) (0,1) ^ Yt{s') 

{s',s)eE 

(1.0) (1,1) Ytis') 

is',s)eE 
(0,1) (0,0) 6o 

(1.1) (1,0) 6i. 

Denote the distribution of {Yt}t>o by ^Jfgf and the distribution at a fixed 

time t by f/j^^^j. The definition of dying out, surviving weakly and surviving 
strongly is the same as for the ordinary contact process. At this point a 
question naturally arises. For fixed 5o,6i,^ and p, do the initial state of the 
background process have any effect on this definition? This point is raised in 
Section 6, where we list some open questions. Note that we are here assuming 
that Bq ~ TTp which then is included in the definition. 
We will write 
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when we mean that there exists a process {Yt}t>o with distribution as above 
and a process {^'}t>o with distribution coupled such that 

Yt{s) < Vs G S and Vt > 0, 

and use the obvious notation for all similar types of situations. This stochas- 
tic ordering also implies that 

It is easy to show that ^^^^^^ is in this sense stochastically decreasing in 
p. We have already introduced this notation for continuous time processes 
in (4) and (5). There it was a relation between jump processes indexed by 
t>0, while here it is a relation between processes with state space {0, l}*^. It 
will be clear from the context which one we are referring to. By the recovery 
process of a site, we mean the process governing the recoveries of that site. 
In the ordinary contact process it is a Poi^ process, while by the definition 
of the CPREE above, the recovery process at every site is in fact a Poi^^^^^ 
process as defined earlier. This explains the relation between Theorem 1.4 
and our next result. 

We will let Aq denote the maximum degree of a graph G of bounded 
degree. We can now list our main results concerning this model: 

Theorem 1.6. Let G = {S, E) he any graph of hounded degree and A<Z S, 
he such that \A\ < oo. For any 5 < min((5i, 5o + 7) there exists ap = p{6, (5o, (^i, 7) G 
(0, 1) large enough so that 

(11) nx ^ 

Furthermore, for 5 > min(5i,(5o + 7) there is no p £ (0, 1) such that (11) 
holds. 



Our next result also uses Theorem 1.4. However, it does so in a different 
way. The reason for this is that a straightforward approach would need a re- 
sult for Aniin,/i(oo5 ^ii 7)P) analogous to the one we have for Amax,^(ttOi oi) 7iP) 
However this is false since Xmm,^i{cto,ai,^,p) is equal to oq for any p> 0. 
Here, let ^Jfsf Bo(A)=o denote the distribution of '^Jf^f conditioned on the 
event that Bq{s) = for every s £ A. 

Theorem 1.7. Let G = {S,E) he any graph of hounded degree. Let A C 
S, he such that \A\ < 00 and 7 > A^. For any choice of 5 > 5q and A < 1 
there exists a p = p{5,\,So,Si,'y) € (0,1) small enough so that 
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Remarks. It is unfortunate that we need the assumption that Bq{s) = 
for every s £ A. However, this is of no importance when we later apply 
the theorem to prove Theorem 1.8 stated below. Also, as A — > 1, the proof 
requires that p — > 0. The hypothesis 7 > Aq and A < 1, might look artificial, 
however a lower bound on 7 is required as Example 5.1 shows, and for 
A = 1, the statement is false as Example 5.2 shows. We thank the referee for 
pointing out these two examples. 

We are now ready to state the main theorem concerning the CPREE 
model of this paper. Results 1-3 use an easy coupling argument while 4- 
6 follow from applications of Theorems 1.6 and 1.7. Here, any statements 
similar to pd < p < Pc2 in the case that pd = Pc2 should be interpreted as 
empty statements. 

Theorem 1.8. Let s £ S, < ^ (^i < 00 and consider the process 
^ &0 &i ■ have the following results: 

1. Assume that 5ci < 5q < 6c2 < Si. There exists Pc2 = Pc2{Sq,6i,^) G [0,1] 
such that dies out ifp>Pc2 cind survives weakly ifp<Pc2- 

2. Assume that 5o < 6ci < dc2 < Si. There exists pc2 = Pc2{So,6i,^) G [0,1] 
and Pel = Pci{So,Si,^) G [0, 1] such that pd <Pc2 and '^J^^l'^^ dies out if 
P > Pc2 survives weakly if pd <p < Pc2 o,nd survives strongly if p < Pd ■ 

3. Assume that 5o < 6d < Si < Sc2- There exists pd = Pci{So,Si,^) G [0,1] 
such that '^J'^s^'^^ survives strongly if p < Pd o-nd survives weakly if p> 

Pel- 

4. In case number 1, if 'j > Sc2 — Sq then pc2 < 1 and ifj> Aq, then Pc2 > 0. 

5. In case number 2, if ^ > Sc2 — Sq then Pc2 < 1, if 1 > Sd — Sq then pd < 1 
and i/7 > Ag, then Pd,Pc2 > 0. 

6. In case number 3, i/7 > Sd — Sq then pd < 1 and ifj > Aq, then pd > 0. 

Remarks. 

• We do not include trivial cases like Sd < Sq < Si < Sc2 in the statement. 

• One might suspect that the condition j > Sc2 — Sq should in fact be 7 > 
Si — Sq, considering the statement of Theorem 1.6. The point is however 
that we must only be able to choose the S of Theorem 1.6 to be larger 
than Sc2, not Si. 

• We would like to point out that even if we only show that Pd,Pc2 < 1 
whenever j > Sd — Sq, "y > Sc2 — Sq, respectively, there is no apparent 
reason why this should not be true for all 7 > 0. Similarly for Pd,Pc2 > 0. 

The rest of the paper is organized as follows. Proposition 1.2 is proved in 
Section 2. This is then used to prove Theorem 1.3 in Section 3. In Section 
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4 we use a limiting argument to conclude Theorem 1.4 from Theorem 1.3. 
We then exploit Theorem 1.4 to prove Theorems 1.6 and 1.7 in Section 5. 
Finally, these last two theorems will be used to prove Theorem 1.8 in the 
same section. 

We exploit the techniques for proving Theorem 1.6 further to conclude 
the following results concerning pd and Pc2- 

Proposition 1.9. Fix i G {1, 2} and assume that 5o < Sd- We have for 

Pcii 

limsuppcj('5o,<5i,7) < — 7^- 

7— >oo Oi — Oq 

Remark. We conjecture that the limit exists and that 

lim Pci(5o,(^i,7) = — T'- 
7^00 Oi — Oq 

We cannot prove this with the techniques of this paper; this is closely related 
to the remarks after Theorem 1.4. However, the intuition why it should be 
true is that as 7 — > 00, the recovery process should become increasingly 
similar to an ordinary Poisson(5o + p{5i — 5o))-process (see the remarks of 
Theorem 1.4). In turn, our CPREE then should become more and more like 
an ordinary contact process with recovery rate 6q +p{6i — 5q). Therefore we 
should get that pc solves the equation 5c = 5o +p[Si — 5q). 

As 7 tends to we can unfortunately not conclude anything about pd- 
The reason is yet again connected to the remark after Theorem 1.4. We 
know that for 7 = 0, Amin,/i(aO) oij 0,p) = ai from Theorem 1.4 and that 
Amax,^t(aO) cti, 0,p) = ctQ. Therefore the stochastic domination techniques we 
use in this paper do not yield any nontrivial results. We also point out that 
the case 7 = 0, corresponds to the CPRE and we therefore refer to the papers 
mentioned in the first paragraph of the Introduction. 

We also have the following easy result about pd, Pc2- 

Proposition 1.10. We have that for any 7 > and 61 > dd > 60, where 
ie{l,2} 

lim pd{So,Si,-f) = 0. 

OOjOci 

Remark. One would of course expect that 

lim Pci{So,Si,-f) = 1. 

OllOci 

However, it is not possible to prove this the same way as we prove Proposi- 
tion 1.10; again this is a fact that propagates from Theorem 1.4. 
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2. Proof of Proposition 1.2. The proof of Proposition 1.2 will require 
the following two results, the first uses Lemma 3.2 of [5] and the second is 
a restatement (which is more suitable for our purposes) of Theorem 1.2 of 
[12]. 

Lemma 2.1. If {Bn}'^=i is monotone then {Xn}^=i is monotone. 

Proof. Let {Zn}n=i ~ TTi-(i-ai)/{i-ao) and {Z'^}^^i ~ T^ao be indepen- 
dent. Observe that {Xn}'^=i has the same distribution as {max(min(i?„, Z„), 
Z^)}'^^i. It follows from Lemma 3.2 of [5] that {mm{Bn, Zn)}'^^^ is mono- 
tone. It then follows similarly that {max(min(i?„, Z„), is monotone. 

□ 

Lemma 2.2. Let ^ he a translation invariant measure on {0,1}^ which 
is monotone. Then the following two statements are equivalent. 

1. TTp ■< fi. 

2. For any n G N 

^i{a{n) = l\a{l, . . . ,n - 1) = 0) > p. 
Proof of Proposition 1.2. Let 

An := F{Xn = l\Xn-l = ---=Xi=0). 

Since {Xn}'^=i is monotone (Lemma 2.1) and translation invariant it is easy 
to see that An is decreasing in n, and therefore the limit A — limfj_»oo An 
exists. It is now an easy consequence of Lemma 2.2 that this limit is equal 

to Pmax,/i- □ 

The above results show that when the assumptions of the theorem hold 
then 

inf ¥{Xn = l\{Xn-l,. . . , Xi) = = p„,ax,M- 

It is very easy to find examples for which this statement is not true. For in- 
stance let (X, Y) G {0, 1} X {0, 1} and F{X = Y = 1)= ¥{X = y = 0) = 1/2. 
This dominates a product measure with positive density so that Pmax.^t > 0, 
while P(X = l|y = 0) = 0. 

3. Discrete time domination results. This section is devoted to the proof 
of Theorem 1.3. {(5„,X„,)}^^ I are the processes defined in the Introduction. 
We start with the following lemma; we do not include the elementary proof. 
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Lemma 3.1. The process {Bn}^^i is monotone. 

We will also need the following lemma which gives us a recursion formula 
of An expressed in terms of An-i- 

Lemma 3.2. We have that 
(12) A. = ^^^. 

with C,D as in Theorem 1.3. 

Proof. The proof is straightforward; however, it involves some tedious 
calculations. We have 

^ ¥{Xn = l,Xn-l=0\iXn-2,---,Xi) = 0) 
P(X„„i=0|(X„_2,...,Xi) = 0) 

_ F{Xn = l,X„_i = 0|(X„-2, . . . = 0) 

1 - An-1 

Observe that 

P(X„ = l|(X„_i,...,Xi) = 0) 

= P(X„ = l\Bn = 1, . ..,Xi) = 0)F{Bn = . ..,Xi) = 0) 

+ F{Xn = l\Bn = 0, {Xn-1, • • • = 0)P(S„ = 0\{Xn-l, ...,Xi) = 0) 

= aiP(B„ = l|(X„_i,...,Xi) = 0) 

+ ao(l - P(B„ = l\iXn-i, ...,Xi) = 0)) 
= ao + (ai - ao)lP(^n = l|(^n-i, . . • , Xi) = 0). 
Therefore 

P(B„ = l|(X„_i,...,Xi) = 0) 

^ P(X„ = l\{Xn-i, ■ . ■ = 0) - ao ^ A„ - ao 
ai — ao ai — ao 

Furthermore, using the above we get 

P(X„ = 1, X„_i = 0| {Xn-2, . . . , Xi) = 0) 

= F{Xn = 1, = 0|5„_i = 1, (X„„2, ...,Xi) = 0) 

xP(B,_i = l|(X„_2,...,Xi)=0) 
+ P(X„ = l,X„_i = 0|S„_i=0,(X„_2,...,Xi) = 0) 
xP(S„_i = 0|(X,_2,...,Xi) = 0) 
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ai — ao 

+ P(X„ = l|X„_i=0,5„_i = 0) 

An~i - ap 
ai — ao 

An-i - ao 



xP(X,_i = 0|5„_i = 0) 1 



[ai(l - 7(1 - p)) + ao7(l - "i) 



ai — ao 



+ [ai7p + ao(l - 7P)](1 - «o) f 1 - ^^^^-^ — ^) 

V ai - ao / 

= — —{[ai{l - 7(1 -p)) + ao7(l - ai) 

ai — ao 

- [ai7P + ao(l -7P)](1 - «o)) 

+ [ai7p + ao(l - 7p)](l - ao). 
Finally observing that 
1 



-[[ai(l -7(1 -p) + ao7(l -ai) 
ai - ao 

- [ai7fi + ao(l -7P)](1 - ao)] 

= [[«! - (ai - ao)7(l - P)](l - ai) 

ai — ao 

- [(ai - ao)7P + ao] (1 - ao)] 

1 



-[ai(l - ai) - ao(l - ao)] - 7(1 -p)(l - ai) - 7p(l 



ai — ao 

= (1 - ao - ai) - 7(1 - p)(l - ai) - 7p(l - ao) 
= (1 - ao - ai) - 7[1 - ao - (1 -p)(ai - ao)], 
and that 

ao 

([ai(l -7(1 -p)) + ao7(l -p)](l -ai) 

ai — ao 

- [ai7p + ao(l-7P)](l-ao)) 

+ [ai7p + ao(l -7P)](1 - "o) 
ai 



ai — ao 
_ gp 
ai — ao 



[ai7p + ao(l - 7P)](1 - "0) 

[ai(l -7(1 -p)) + ao7(l -p)](l -ai) 
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1 



-[[ao + ("1 - ao)7P](l - ao)ai 



ai — tto 

- [ai - (ai - ao)7(l - p)]{l - ai)ao] 

1 



-[ao(l ~ ao)ai — — ai)ao] 



ai — oq 

+ 7p(l - ao)ai + 7(1 - p)(l - ai)ao 
= aooi + 7P(1 - ao)ai + 7(1 - - ai)ao 
= aooi + 7[(P - ao + (1 - p)ao)ai + (1 - p)ao - (1 - p)aoai] 
= aoai +7[ai(l - ao) - (1 -p)(ai - ao)], 
completes the proof. □ 

We are now ready to prove Theorem 1.3. 

Proof of Theorem 1.3. From Proposition 1.2 we know that the limit 
A = lim„^oo^n exists, and therefore we can take the limit of both sides of 
equation (12) (A^ is easily seen to be uniformly bounded away from 1) to 
conclude that 

. y . r CAn-i + D CA + D 
A = lim An = lim = — . 

n-»oo n^oo 1 — A„_i 1 — A 

This gives us that 

A- A^ = CA + D, 

and therefore 

A^ + {C -l)A + D = Q, 
solving this equation gives 



A = \{1 - C ± J {I - Cf - AD) 



= i(l - C ± V^(2ai - (1 - C)f - A{D + ai-ai{l- C))). 
We will now proceed to rule out one of the solutions: 
D + a\-ai{l-C) 

= a\- ai + ao"! + 7(ai(l - ao) - (1 - p)(ai - ao)) 
+ ai((l - ao - ai) - 7(1 - ao - (1 -p)(ai - ao))) 
= 7(ai(l - ao) - (1 - p)(ai - ao)) - 7ai(l - - {I - p){ai - ao)) 
= 7(-(l - p)(ai - ao) + (1 - p)ai{ai - ao)) 
= -7(1 -p)(ai - ao)(l - ai). 
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Using that 7(1 — — ao){l — ai)) > we get 



i(l - C + {2ai - {1 ~ C) f - A{D + af - ai{l - C))) 



> 1(1 - C + (2ai - (1 - C)f) > i(l - C + (2ai - (1 - C))) = a^. 



Obviously we cannot have 



A > ai, 



since already [for j,p£ (0, 1)] 

A2 = F{X2 = l\Xi=0)<ai 
and A < A^. for every n. We conclude that 



A = \{l-C-^{l-CY-AD). 



Using Proposition 1.2 we then conclude that Pmax,^ = A. Finally, the result 
for Pmin,^ follows from an easy symmetry argument. □ 

Observe that when ao = ai = a, is i.i.d. andpmax,^ =Pmm,/i = 

Note that in this case C = 1 — 2a — 7(1 — a) and = 0^+ 70(1 — a), and 
so 



as we should get. Similarly one can check that Prnin^^ — 

Furthermore if we choose 7 = 1, {Xn}'^=i is again i.i.d. and we would 
expect to get that Pmax,^ =Vnna,^l = OiQ + p{ai — ao)- Again, this is easy to 
check. Finally, as 7 —> we get that Pma.x,^i oo and Pmin,^ — > ai. It is not 
hard to see why this is what we should expect. 

4. Continuous time domination results. In this section we prove Theo- 
rem 1.4. 

For T > 0, let L'n[0,T] be the set of functions from [0,T] to N that are 
right-continuous and have left limits. Let L'n[0,oo) be defined in the same 
way, but with [0, T] replaced by [0, 00). Let a function be called a count path 
if it is a nondecreasing function that takes integer values and has jumps of 
size 1. Define Dc C -Dn[0, 1] to be the set of count paths. Dc is closed under 
the Skorokhod topology, see [4], page 137. 

Let ao,ai,7 > and let m be such that ao,m := Oio/m, ai^m '■= ai/m, 
7m := 7/m E (0, 1). Consider the model in the last section with ao, ai and 7 
replaced by ao.mjOi.m and 7^, respectively {p is not changed). Denote the 



Pmax,/i — 2 



i(2a + 7(l-a) 



(2a + 7(1 - a)f - 4(a2 + ^a{l - a))) 
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corresponding processes by {(S™, but consider only the truncated 

part As in the Introduction, let 

n 

X'/-=Y^XT fornG{l,...,m}. 
Define the continuous time version X™)}jg[o,i] t>y letting 



(13) {BT.XT) = {Bl^'^X^n for t G [n - l,n)/m and n G {1, . . . ,m}, 

and = {B^,X^). According to Theorem 1.3, we can couple 

the {(-B™, X™)}™^]^ process with an i.i.d. process {5^}™=! with density 
Pmax,/im (where fj-m denotes the distribution of {X^}^^i) such that 

(14) ir<^r VnG{l,...,m}. 

Here Pmax,^t™, is given by Theorem 1.3. Define {Y^'"^}^^i in the obvious way 
and the continuous time version {^™}tG[o,i] by letting 

ym^y^cm for t G [n- l,n)/m, nG{l,...,m} 
and Yf^i = Y^^. We get from equation (14) that 

(15) X™ — Y^ is nondecreasing in t Vn G {1, . . . , m}. 

We state the following lemma; the proof is an elementary exercise in 
convergence in the Skorokhod topology. 

Lemma 4.1. The set {{f,g)£DcXDc:f — g is nondecreasing} is closed 
in the product Skorokhod topology. 



Consider now {{Bt, Xt)}t£[o^i] defined in Section 1. Recall that the flip 
rate intensities corresponding to {{Bt, Xt)}t^[Q^i] are 



from 


to 


with intensity 


(0,A;) 


(l,fc) 


7P 


{l,k) 


iO,k) 


7(1 -p) 


iO,k) 


(0,A; + 1) 




{l,k) 


(1,A; + 1) 


ai 
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for any k >0. Observe that for {{BJ^ , X^'"^)}'^^^ we have the transition 
probabihties 



from 


to 


w.p. 


(0,A;) 


il,k) 


(7p/m)(l — ai/m) 


il,k) 


iO,k) 


(7(1 - ao/m) 


{0,k) 


{l,k + l) 




il,k) 


{0,k + l) 


7(1 -p)ao/m2 


{0,k) 


{0,k) 


(1 — ao/m){l — ^p/m) 


il,k) 


{l,k) 


(1 — ai/m)(l — 7(1 — p)/m 


{0,k) 


(0,fc + l) 


{ao/m){l - 'jp/m) 


il,k) 


ihk + l) 


(ai/m)(l — 7(1 — p)/m). 



Using the flip rate intensities of equations (16) and (17), it is a standard 
result to show the next lemma. Again we omit the proof. However, see, for 
instance, [6] for a survey on the convergence of Markov processes in general. 



Lemma 4.2. The sequence of processes {(S™, Xf"*)}(g[oj] defined above 
and indexed by m, converges weakly to the Markov process {(i?^, X()}jg[o,i] • 

We are now ready to prove our main results of this section. We will start 
by proving the following lemma. 

Lemma 4.3. With the assumptions of Theorem 1.4, we have that 

Amax,M(ao,ai,7,p) > A. 

Proof. We will start by constructing the coupling on the finite time 
interval [0, 1] and then argue that we can extend it to infinite time. 

Let {{B'j^,Xl^,Y{^)}f^[Q ^ be any sequence of processes indexed by m 
where, as indicated by the notation, the marginals {(-BJ", X^)}(g[Q and 
{yj*"}jg[o,i] have the distribution of the processes defined at the beginning 
of this section. Furthermore assume that these marginals are coupled so that 
— is nondecreasing for every m. Obviously the marginal {^™}tG[o,i] 
converges weakly to a Poisson process {^}te[o,i] with intensity 

lim mpmax,/i„ 

= lim ]-(ao + ai + j(l-—ao-{l-p) — {ai-ao) 
m-»oo 2 \ \ m m 

-^(^(^ao + ai + j(^l-^ao-{l-p)^{ai-ao)^^ 

-4^aoai + 7(^ai(^l - ~"o^ - (1 -p)(ai - "o)^^^ 
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= ^(ao + ai + 7 - \l (ao + ai + 7)^ - 4(aoai + 7(00 + p{ai - ao)))) 

= ^(ao + ai + 7 - (ai - ao - 7)^ + 47(1 - p){ai - ao)) = A. 

Lemma 4.2 shows that also the sequence {(i?™, X™)}^^^,!] converges weakly. 
It can then be argued that the sequence {(-Bf*, X^*", y^'")}^^^,!] is tight and 
so there exists a subsequence {{{B^^^\x^^^\Yl^^^^)}^^]f)^}'^^'^^ that con- 
verges weakly to some process {{Bt,Xt^Yt)}t(^[\i,i]- Of course, the marginal 
distribution {(-B*, ^t)}te[o,i] must be equal to the distribution of -^t)}te[o,i] > 
and the marginal distribution {lf}tg[o,i] must be equal to the distribution 
of {i^}tg[o,i]- Furthermore using Lemma 4.1 we conclude that 

(18) Xt — Yt is nondecreasing. 

It not hard to see that we can adapt the proof to work for any time interval 
[0,r]. It is then easy to construct the coupling on -Dn[0, 00). Hence we have 
established that 

Amax,M(«0,ai,7iP) > A. □ 

Considering {(5;^*, X^)}^=i, let for every m, i > 1 A™ := P(Xf = l\X^^ = 
• • • = X™ = 0), and let := Pmax,^™ = hnij^oo Af^. In our next lemma, we 
will need that Tm (where T > 0) is an integer, which will not always be the 
case. However, adjusting the proofs for this is trivial and we therefore leave 
it to the reader. The same comment applies for other results to follow. 

Lemma 4.4. For any T > 0, 
hm mA^^ 



A + {pai + (1 - p)ao - A) 



-(Q0+ai+7)T 



e-^^P(Xt = VtE [0,r]) 



Proof. Let C™, denote C, D of Theorem 1.3 with parameters a^jra^ 
ai/m, 7/m and p. By Lemma 3.2, for any n, 



Am _ Am 

1 - A'^_^ 1 - A"^ 



(C'"^;f„i + - A"*) - (C^A"^ + L>™)(1 - A™ 



(1-A™ i)(l-A" 

c""(a;7_i - A™) + L>'"(A™_i - A"*; 

{\-A^_^)(\-A^) 
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' _j_ \ n— 1 ^ 



/ _|_ \ ' 



Furthermore 

C™ + -D™ = {1 — aQ/m — ai/m) — 7/m(l — ao/m — (1 — p)(ai/m — ao/"^)) 
+ aQai/w?' + 7/m(ai/m(l — ao/m) — (1 — p){ai/m — ao/m)) 

= 1 — ao/'^ — + aoOi/'Ti^ 

— 7/m(l — ao/"^ — ai/m(l — ao/m)) 
= (1 — aQ/m){l — ai/m)(l — 7/m). 

Recall also that we in Lemma 4.3 proved that A = limm_»oo "zA™. We get 
that: 

1. lim™^oo(C"" + D™)^"^-! = e-(°o+"i+T)7^, 

2. lim„^oo(l - = lim^^oo e(Tm-i)log(i-A'") ^ 
lim g(Tm-l){-A-+0({A™)2)) _ -AT 

3. lim™^oonrrr'(l - = lim^-.ooP(^r = O Vt G [0,T - 1/m]) = 

p(Xf = vte[o,r]), 

4. my4"^ = m{pai/m + (1 — p)ao/m) = pai + (1 — p)ao- 
Therefore 

lim mATm 

' (-tm I rtm \ Tm—l 

(19) = lim mA"" + (mAV' -mA"")' ^ 

m— >oo 

= A + {pai + (1 - p)ao - A) 



-(ao+ai+7)r 



e-^^P(Xt = Vi G [0,r])' 
as desired. □ 

Next we prove the upper bound in Theorem 1.5 of A^^x.^tl'^Oi oii 7)P)- 

Lemma 4.5. For every choice 0/ oq, ai, 7, T > 0, with oq < ai and p G 
(0, 1) we have that there exists a constant E > 0, depending on ai,aO)7 and 
p such that 

1 - 1 - e~^^ 
-^max,M(«o,ai,7,P) < A + - (pai + (1 -p)ao - A) . 
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Proof. We have that 

Tm ^ 

P(Xr = Vt G [0, T]) = n (1 - = e^^-i '"'^^^"^^^ 

(20) 

Using equation (20) it is easy to see that it suffices to get an estimate 
on Yll~=i^T- '^o t\\aX end, let n > be an integer and let := kT/n for 
/c e {1, . . . ,n}. Using that for fixed m, is decreasing in k, we get that 

Tm Tim T2m T„m 

k=l k=l k=Tim+l k=T„-im+l 

< TimAT + (T2 - Ti)m^??^ + . . . + (r„, _ r„_i)mA?J_^^. 

Using equation (19), that mA'P = pai + (1 —pao) and that (T^ — T/j_i) = T/n 
for every k, we get that 



Tm 

lim y^? 

fc=l 



(21) <-(pai + (l-p)ao) 
n 



n-l rp r_ _ ^-(^ao+ai+"f)Tk 



k=i " 



A + {pai + (1 -p)ao - A)- 



P(Xj = OVtG[0,Tfc]) 



Note that the existence of this limit follows from the existence of the limit on 
the left-hand side of equation (20). We observe that trivially F{Xt = Vt G 
[0,T]) > e-"i'^ and so we get that 

p-(ao+ai+7)Tfc 



< exp(-(ao + ai + 7)Tfc + XTk + aiTk) 
= exp -—-{ao + ai +7 



+ y (ai - ao - 7)^ + 47(1 - P)(ai - "o)) + oi^fc 

: expf (ao + ai + 7 + |ai - ao - 7I + 2i?) + aiT^ 
■ exp(Tfc(ai — max(Q;i,Q!o + l) — E)) < e~^"^*. 
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where E solves the equation 

\ai - ao - ^\ + 2E = \J\ai - - 7^ + 47(1 -p)(ai - ao). 
We get that 

rp n — 1 rp n — 1 

(22) <^T.--'^' = lT.ie-'^h' 

" fc=l '^^ fc=l 



rp / ^-TE/n_^-TE ^^-TE/n_^-TE 



n\TE/n + 0{l/n'^)J \ E + 0{l/n) 

Combining equations (21) and (22) and taking the hmit as n tends to infinity 
(after taking the Hmit as m tends to infinity), we get that 

Tm _ _ _ -TE/2 

hm Y,Af<T~X + {pa, + {l-p)ao-~X) . 

k=l 

Combining equation (20) with this yields 
P(Xt = VtG [0,T]) 

= lim P(X™ = ViG [0,T1) 

m— »oo ^ L J J/ 

> exp i^- i^TX + (pai + (1 - p)ao - A) j j . 

Finally we conclude that 

- 1 - l-e-'^^/2 
Amax,/.(ao,ai,7>P) < A + -(pQi + (1 -^j)ao - A) . □ 

Remark. It is interesting that in the above proof we "lift ourselves up 
by the boots" by using a simple estimate for W(Xt = Vt G [O,?"]) to obtain 
a better one. 

Proof of Theorem 1.4. The first statement follows immediately from 
Lemmas 4.3 and 4.5, by letting T tend to infinity. 

We can of course trivially conclude that Amm,/i("0) "i) 7)P) < cti- To see 
why we have equality consider the event 

{There are at least k arrivals during [0,1]}. 
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Let a < ai , we have that 



oo 




—a 



a 



n ■ 



oo 



-Poia'o^cn (There are at least k arrivals during [0, 1]) >pe ^ 

l=k 




Since 



fc— too 



oo 



we get that for every a < ai, 7 > and p> there exists a k such that 



and so Amin,M(ao, «!, 7>P) > "i- ^ 

Remark. It is actually possible to prove the statement without using 
Lemma 4.5, and we give here a short informal description how this can 
be done. To show that Amin,^ < A directly from Theorem 1.3, start with 
the processes {{Bf, Xt)}t>o and {lt}j>o with distributions as indicated by 
the notation (the latter process with parameter A) coupled so that {Xt}t>o 
has an arrival whenever {Yt}t>o has an arrival. For any m, it is straight- 
forward to discretize these processes resulting in processes 
and {Y^}^^i with distributions as indicated by the notation, but with pa- 
rameters ao/m + 0{l/m'^),ai/m + 0{l/m?),^ /m + 0{\/rn?'),p and A/m + 
0(l/m^), respectively. Furthermore this is done so that {X™}^]^ is coupled 
above {1^}^^. Using Theorem 1.3 we arrive at 



where /i"* is the distribution of {X^jJ^j^. Multiplying with m and letting 
m go to infinity gives the result. 

In the next section we will need the following easy corollary to Theo- 
rem 1.4. 

Corollary 4.6. For any 5 < mm{5i,6o + 7) we can find a < p < 1 
close enough to one so that 




X/m + 0{l/m'^) <p, 
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Proof. We just need to observe that 

lim Amax,M(5o,<5l,7>P) 

(23) = lim 1 (5o + 5i + 7 - J {Si -6o- 7)^ + 47(1 - p){6i - 60)) 

= + (5o + 7 - |(5i - (5o -7I) =mm((5i,(5o +7). □ 
Observe that 

Poi]^^5^ (There are no arrivals in [0,t]) > (1 -p)e"^*e"^°* = (1 - p)e"(^+^°)* 
and that 

Poi5(There are no arrivals in [0,t]) = e~^*. 

Therefore, if 5 > 7 + 5o, we have for fixed p and some t that 

e--?* <(l_p)e-(T+<5o)t^ 

and so we cannot have that 

Poi5r<PoiJ,;^,^, 

which is an alternative way to see why the limit in equation (23) cannot 
simply be equal to 61. 

Proof of Theorem 1.5. The upper bound is just Lemma 4.5. 

For the lower bound, we start by observing that using Theorem 1.4 we 
trivially get that F{Xt = Vi G [0,r]) < e'^^ . Therefore by equation (19), 
using that pai + (1 — p)ao > A [which follows from the fact that A is increas- 
ing in 7 with limit pai + (1 — p)ao, see remark after Theorem 1.4], 

lim mAr^ 

g-(ao+ai+7)T 

> \ + {pai + (1 -p)ao - A) 

= A + {pai + (1 - p)ao - A)e~^^. 

We therefore need to show that — li™m-»oo ^^Tm- Observe that the 

second marginal of the discrete time process {(S™, X^)}^!!\ trivially dom- 
inates an i.i.d. sequence of density ^^Vn- Therefore, going through a limit- 
ing procedure very similar to the one of Lemma 4.3, we get that the sec- 
ond marginal of {{Bt,Xt)}t£[o^T] dominates a Poisson process with intensity 
limm_^oo 'iT'^Tm °^ time interval [0,r]. 

The result for A^j^^^ follows as in the proof of Theorem 1.4. □ 
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5. CPREE-results. 



Proof of Theorem 1.6. For every site s £ S the recoveries of the 
'^If 'sf process at that site has the same distribution as the arrivals of a 
PoiJ^^_^ process. By Corollary 4.6 we can couple the processes ^Jf^t 

so that at every site the former has a recovery whenever the latter does. 
Furthermore, coupling the infection rates are of course trivial. This gives the 
first result [equation (11)]. 

Trivially the statement cannot hold if (5 > 5i. Furthermore, if (5 > (5o +7, 
then by letting x (z A, and noting that for T large enough, 

*S>*(^) = ivtG[o,r]) 

> (1 - p)e-^'>^e-^^ > e"^^ > ^^fiMx) = 1 Vt G [0, T]), 
we are done. □ 



For Acs such that \A\ < 00, let BiA)=o denote the CPREE where 

a site s £ S always is healthy (i.e., in state 0) as long as the background 
process of the site s is in state 1. That is, we do not allow the site to become 
infected if the background process of the site is in state 1. More precisely, for 
any graph G = (5, E) let {{Bt,Yt)}t>o be a pair of processes with state space 
{{0,1} X {0,1}}"^ such that Bq ~ vTp conditioned on the event that Bq{s) = 
for every s £ A, and let Yq{s) = 1 iff s £ A. Observe that the conditioning 
does not affect the probability of Bq{s) being or 1 for any s ^ A. Let the 
pair evolve according to the following flip rate intensities at any site s. 

from to with intensity 

(0,0) (1,0) 7P 

(0,1) (1,0) 7P 

(1,0) (0,0) 7(1 -p) 

(0,0) (0,1) Ytis') 

{s',s)eE 
(0,1) (0,0) 60. 

Observe that with this definition the state (1, 1) is not allowed. Informally, 
this can be interpreted as letting the rate of recovery when Bt{s) = 1 be 
infinite, hence the notation. 



Proof of Theorem 1.7. We start by observing that it is easy to see 
from the definitions of ^lX,Bo{A)^o ^nd ^IX,b{A)^o ^^at 

*5o,oo,B(A)=0 - ^So,Si,Bo{A)=0- 
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We will construct {{Bt,Yt)}t>o to have distribution ^Jf^ b{A)=o some p 
close to 0, and couple it with a process {Y^}t>o such that {Yt}t>o stochas- 
tically dominates {Y^}t>o- It will be easy to see that in turn {Y/}t>o will 
stochastically dominate 

We now proceed to the actual construction. Let Bq^^ -Kp, conditioned on 
the event that Bq{s) = for every s £ A. For every site s £ S, associate an 
independent process {Bt{s), Xt{s)}t>o such that {1 — Bt{s),Xt{s)}t>o is the 
model of Theorem 1.4 with oq = 0, ai = Ac and with p replaced by 1 — p- 
We get from Theorem 1.4 that 

Amax,/i(0, Ag,7,1 -p) 

= i(0 + Ag + 7 - \/(Ag - - 7)2 + 47(1 - (1 - p))(Ag - 0)) 

= i (Ag + 7 - \/(Ag - 7)^ + 4Ag7P), 

that is, we can couple the pair of processes {Bt{s) , Xt{s)}t>o with a Poisson 
process {Xl{s)}t>o with intensity Amax,^t(0, Ag, 7, 1 — p) such that if this 
latter process has an arrival then so does {Xt{s)}t>o. There is a slight is- 
sue with s £ A, where we have conditioned that Bq{s) = 0. However, this 
corresponds to conditioning that the background process of Theorem 1.4 
starts in state 1 , and it is not hard to see that the conclusion of the theorem 
is still valid in this case. Informally, if we in this theorem start with the 
background process in state 1, this means that we are starting in the higher 
intensity state, and so it becomes "easier to dominate." It is easy to make 
this statement precise. 

Let for every s £ S, {Dt{s)}t>o be a Poisson process with intensity 60, in- 
dependent of each other and all other processes, and consider some quadruple 
{Bt{s), Xt{s), Xl.{s), Dt{s)}t>o with marginal distributions as indicated by 
the notation. We now proceed to construct {{Bt,Yt)}t>o (the first marginal 
is of course already defined) and {Y/}t>o from these four processes. Let 
Yo{s) = Yt^{s) for every s € 5 and let Yo{s) = Y^^is) = 1 iff s e ^. Let for 
every s £ S {{Bt{s) ,Yt{s))}t>Q and {^/(s)}t>o denote the marginals of the 
processes {{Bt,Yt)}t>o and {^/}t>o at the site s. 

Let N{s,Yr{s)), N{s,Y^{s)) denote the number of neighbors of the site s 
that are infected at time r under {Yt}t>o and {Y^}t>o, respectively. Recall 
that by definition, for any s £ S, Yq{s) = Yq{s) = if Bq{s) = 1. We will write 
Xris) / X^~ (s), X!^{s) / X'^_ (s) and Dr{s) / D^- (s) to indicate that these 
processes have an arrival at time r. Observe that by construction, for every 
s G 5 and i > 0, if X'^{s) / X'^_ (s) then X^(s) / X^- (s). We wiU also write 
B^~ (s) < Bt-(s) when we mean that the Bt process flips from to 1 at time 

T. 
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At time r, {{Yt{s),Y/{s))}t>o will change: 

from to if 

(24) (1,1) (0,0) Dr{s)^D,-{s) or B,-is)<Br{s) 
(1,0) (0,0) Dr{s)^D,-{s) or B,-{s)<Br{s) 



and also: 



(25) 



from to w.p. if 

(0,0) (1,1) N{sX{s))/Ag XUs)^X'^4s) 

(0,0) (1,0) iN{s,Yris))-NisXis)))/AG x;(s)/x;_(5) 

(0,0) (1,0) N{s,Yr{s))/AG XUs) = X'^4s) 

Xr{s)^X,-{s) 

(1,0) (1,1) N{sX{s))/Ag XUs)^X'{s). 



No other transitions are allowed. Note that by construction {Xt{s)}t>o and 
{X^{s)}t>o only have arrivals when {Bt{s)}t>o is in state 0. Therefore, these 
rates make sure that {Yt}t>o and {^/}t>o are in state when {Bt{s)}t>o is 
in state 1. Note also that since N{s, Yq{s)) = N{s, Yq{s)) for every s G 5, the 
rates make sure that 

Yt{s)<Yt{s) VsG5, t>0, 

and that N{s, F/(s)) < N{s, Yt{s)) for every s£S and t > 0. 

It remains to check that {{Bt,Yt)}t>o and {Y^}t>o have the right distri- 
bution. As noted above {Yt}t>o is if {Bt}t>o is 1. Furthermore it is easy 
to see that when {Bt}t>o is 0, {Yt}t>o flips from to 1 at rate N{s,Yr{s)) 
and from 1 to at rate Sq. It is also easy to see that {y/}4>o flips from 1 
to at a rate which is the minimum of two exponentially distributed times 
with parameters 6o and jp, the latter being the rate at which {Bt}t>o flips 
from to 1. Hence {^'}t>o Aips from 1 to at rate 6q +7P and by choosing 
p small enough this is less that 6. It also not hard to see that {Y/}t>o flips 
from to 1 at a rate Amax,/i(0, Ag',7, 1 — p)A^(s, y/(s))/AG'. Furthermore by 
choosing p perhaps even smaller, we get that 

Amax,/.(0, Ag,7, 1 - p)N{s, Y{{s))/Ag 



(Ag + 7- \/(^g-7)2 + 4Ag7p) 
2/\g ^ 

>XN{sXis)). 

Here we used that 7 > A^. Therefore {Y^}t>o is a contact process with 
infection rate larger than A and with recovery rate less that 6, and so the 
distribution of {i^'}t>o dominates □ 
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Example 5.1. Let S = 2, and A = {— n, . . . , 0}. We have that 
*Io!'iB„(A).oK(l) = OVtG[0,T]) 

> *Ic;!'^,Bo(A).o(^*(l) = 1 Vt G [0,r]) =pe-^^. 

Furthermore, using CoroHary 3.22 and Theorem 3.29 of [10], it follows after 
some work that for some constants ET, e,e' > 0, 

$^'^(at(l) = Vt G [0, T]) < Ke-'"" + e"^'^. 

By letting n go to infinity we see that if 7 < e' we cannot have 

— ^ 5o,oo,Bo{A)=0- 

Furthermore it is possible to modify this example to work for large 5i rather 
than 5i = CO. This is done by considering how long the site {1} is infected 
during the time interval [0,T] rather than the probability of this site not 
being infected at all during [0, T]. 

Example 5.2. Assume that x,y £ S, are neighbors and that A = 1. 
We have that ^^■^"^(^^(y) = l) = t + o{t) while ^Jfi%^,)^o(My) = 1) = 
(1 — p)t + o{t), hence for p positive we can find t small enough so that 

We are now ready to prove Theorem 1.8. 

Proof of Theorem 1.8. We will start with the existence of pd and 

Pc2- 

Let < pi < p2 < oo and let {Bl}t>o, {Bf}t>o be two background pro- 
cesses with parameters pi,P2, respectively. Let Bq have distribution TTp^ and 
Bq have distribution tt^j and couple them so that Bq{s) < Bq{s) for every 
s G S*. It is easy to see that we can then couple the processes so that 

B^{s)<B^{s) Vt>0, Vsg5. 
Using these processes to construct {{B^ ,Y^^)}t>o and {{B^ ,Yi^)}t>o with 
distributions "^If^f'^ ^S'^'^' 

is easy to see that we can couple the 

marginals {y/}t>o, {'5^j^}t>o so that 

Yt^{s)<Yt^{s) Vt>0, VsG5. 

This establishes the existence of pd and Pc2- 

Consider now the part of statement 4 concerning pc2 > 0. Choose 6 > 5o 
close enough to a.nd A < 1 close enough to 1 so that the contact process 
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survives weakly. Observing that ^^J^'^^ is a convex combination of 
^7iPi{«} "^1'^'^ ui \ 1 and using Theorem 1.7 gives the result. 

00,00, B(s)=0 do,QO,B(s)=l ^ ^ 

All of the statements about Pci,Pc2 > are proved in exactly the same 
way. All of the statements about Pci,Pc2 < 1 are proved in a similar way, but 
follow even easier since we can use Theorem 1.6 directly without worrying 
about the initial state of the background process at s. □ 



Proof of Proposition 1.9. We wiU show the theorem for pc2, the 
proof for Pel is identical. First, we use Taylor's expansion to see that 

lim Amax,/i(<5o,<5i,7>P) 

7— >oo 



lim -{5o + Si+-f- J{6o + di+7y -4:{6oSi + -f{5o+p{6i-6o)))) 

■y — ^00 2 ^ 



Inn -(5o + ^i + 7) (1 - Jl - 4 ^^^^^^^p ) 



7^00 2 

: lim l-{So + Si +7) 

7^00 2 



X 1 



4(^0^1 + 7(^0 + Pi^i - So)))/{5o + 61+ 7)^ 



+ 



= lim . , . , \-0[-] =5o+ p{6i - 60). 

It is now clear from Theorem 1.4, the proof of Theorem 1.6 and the above 
calculation that given any e > 0, we can find 7' large enough so that with 
6 = 60+ p{Si — 60) — £ we have that for all 7 > 7' 

and so the '^Jfsf '^^^^ ^0 +^(^1 — ^0) — £ > <^c2- This is the same as 

saying that for any e > there exists 7' large enough so that for all 7 > 7', 
if 

5c2 -So + e 
P^~x A — ' 

the process dies out. Therefore for every 7 > 7' we have that 

Pc2{0f),6i,-f) < — . 

01 - Oo 
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We can therefore conclude that 

7^00 di — 5q 



hmsuppc2('^o,'5i,7) < T n 

'v^^ Oi — On '— ' 



Proof of Proposition 1.10. We show the proposition for pc2; the 
proof for Pel is identical. Using the trivial facts that \/l — x <1 — x/2 for 
< X < 1 and that 

-(5o-5i-7)2- ' 

we get that for any p, 

Amax,Aj(5o,<5l,7)P) 

= ^{So + h+l- \J {5i -60- 7)2 + 47(1 - p){5i - 5o)) 
= ^{^o + h+ l- \l (<5o - 5i - lY - 4p7((5i - do)) 



\6, + 5i^,-\5,-5i-,\Jl 4^^('^^-^o) 



2V " ' ' ^ "V ('^o-5i-7) 



> o h^o + di + 7 - |do - di - 7| + 7j r = do + 



|do-(5i-7|/ |5o-(5i-7| 

Therefore, for every p > 0, we can choose 5o < 6c2 sufficiently close to 5c2 
so that Amax,^t(<^0i'^ii7)P) > ^c2- Therefore, as above, the process ^l^^f dies 
out and therefore 

lim pc2{6o,5i,j) <p. 

O0\Oc2 

Since p > was arbitrary, lim^gi^^j pc2{5o-,5i,^) = and we are done. □ 

6. Open questions. We here list some open questions related to the re- 
sults of this paper. 

1. Do either of the critical values pd and pc2 depend on the initial state of 
the background process? 

2. Instead of studying the CPREE model one could study other interacting 
particle systems such as a stochastic Ising model in a random evolving 
environment. 

3. Is it possible to generalize the model used for the background process 
in some way? For instance, can we analyze the situation where we allow 
more than 2 different states? 
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